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(57) Abstract 

An automatic program selector for controlling remote appliances has control responders including a control tablet 
(20) which employs a viewscreen to display a variety of words and images, and a pointing pen (30) to activate a point- 
screen (64) which overlays the viewscreen (62) and Is coincident with same. By using the control tablet (20) a user may se- 
lect from numerous pictorial, graphic, and alphanumeric displays, a function a user wishes the appliance to perform. Use- 
ful With entertainment appliances, the control can activate command sequences which are readily initiated by the simple 
act of selecting with the pointing pen (30) a desired program from a guide displayed on the viewscreen. The control tablet 
(20) alone or in combination with a responding holder (100), automatically issues the correct commands, including chan- 
nel conversions, for example, to direct appliances to the selected program, or to record programs at a desired time in the 
future. 
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Fdckgjound — Field of Invention 

This invention relates to the remote control of appliances, particularly to a remote control 
device for sophisticated entertainment and other appliances. 

Background — Description of Prior Art 

Numerous types of remote devices exist for controlling appliances. Hand-held remote con- 
trol (RC) devices are a particularly popular means for controlling entertainment appliances 
such as televisions, video-cassette recorders, satellite channel solectors, and the like. The 
number of command options for each appliance has grown, as has also the variety of ap- 
pliances which can; be remotely controlled. 

Certain features are relatively easy to operate using one or more pushbuttons on the face of 
prior-art RC devices. For example, users find it simple and obvious to adjust audio volume 
with a RC device having two pushbuttons with respective arrow symbols for UP and 
DOWN. However, difficulties arise when many different commands arc possible since 
these must be abbreviated. These difficulties are multiplied when a plurality of appliances 
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must be remotely controlled. Nonetheless, RC device, have become increasingly popular. 

Recording machines such as VCRs. now make it possible to save audio or video broadcast 
programs for viewing at more convenient times. While RC devices can be used to program 
these machines *o select a future time and channel, difficulties arise because the many 
step* required eonf use the average user, so this valuable feature often goe, unused. 

Simirar problems are common with other household appliance controls, such as microwave 
ovens. One must memorize a code, or abbreviation, or sequence of programming steps. 
Perhaps the most limiting aspect or all these controls is their reliance on fixed-designation 
pushbuttons. Any appliance with new command options would require a new control with 
a different set of pushbuttons. Alternatively, if the pushbuttons have multiple designa- 
tions, the choice may not be obvious so that the user has to remember which function is as- 
signed to which button. It is for these reasons that the user may acquire several hand-held 
devices to control several appliances. ' 

A hand-held RC device operable for controlling a plurality of machines is described in 
patent 4,566,034 to Hargcr, 1986 Jan 21. While Harger's provides an improved device for 
controlling the few pieces of equipment for which it is designed, it i, again limited to the 
fixed functions designated on its respective pushbuttons. 

Other RC dcvices.are available which have a viewing screen for indicating choices avail- 
able. However the; viewing screen provides a severely limited choice of options, usually for 
but a single set of icommnnds for a single appliance. Some device, may be available that can 
be programmed with coded information, but the program choices must be derived from a 
fixed source whose versatility is severely limited. 
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Objects and Advantages 

Accordingly several objects and advantages of the present invention are to provide an RC 
device that can issue many different commands, yet which is very easy to use, which ean 
control multiple appliances, especially TVs, VCRs and the like, which can easily be used to 
record multiple programs at future times and dates, which does not use fixed-designation 
pushbuttons, which does not require the memorization of codes, which can use a single 
device to replace multiple devices, which can be used for controlling complex functions, 
which can be used to provide an extensive wide variety of choices on its own screen, and 
which can provide its own set of program choices. 

Further objects and advantages are: to provide an RC device ^ with a screen that can be 
dynamically alters* to display all of the controllable functions and status information for 
an appliance, along with program guide information available for the appliance, to provide 
a method of controlling the appliance from the RC device, to provide a method of selecting 
program guide and device control information displayed on the RC device for the ap- 
pliance, to provide a method for the RC device to receive and store program guide and 
status information for the appliance, to provide a method or storing in the RC device, 
program selection information for future viewing and recording on the appliance, to 
provide a method: by which the RC device will allow a- user to control similar appliances 
from different manufacturers in the same way. and to provide a method for controlling a 
multitude of appliances, with the same RC device, in the manner just discussed. 

Further objects and advantages will become apparent from a consideration or the accom- 
panying drawings and ensuing description. 
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Drawing Figures i 

Fig 1 is a view of the front and top of an RC device according to the invention. 
Fig 2a is a view of the underside of the RC device of Fig 1. 
Fig 2b is a view of the back of the RC device of Fig 1. 

Fig 3 is a view of; the front and top of a holder for the RC device of Fig 1. 

Fig 4 shows an exploded view of the viewsereen and conductive pointsereen- membrane of 
the RC device of Fig It 

Fig S is a pictorial representation of a typical spread-sheet style television program guide 
displayed on screen of RC device of Fig 1. 

Fig 6 is a representation of an exemplary select appliance mode menu screen. 
Fig 7 is a representation of a exemplary compact disk mode selection screen. 
Fig g is -a block diagram of circuitry of RC device of Fig 1. 
Fig 9 is a block diagram of circuitry of holder of Fig 3. 
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Fig 10 shows a typical video appliance configuration where the program guide Information 
is read by the holjder of Fig 3. through an external medium. 

Fig 11 shows a typical video appliance configuration where the program guide information 
is downloaded from a cable decoder into the holder of Fig 3. 

Fig 12 shows an alternate embodiment wherein the television appliance is used to display 
the viewscreen. 

Fig 13 is a flowchart listing of the program loop for the RC device of Fig 1. 

Fig 14 is a flowchart of the interrupt background program running in the RC device of 
Fig 1. . 

Fig IS is a flowchart listing of the program running in the holder of Fig 3. 

Fig 16 is a modified version of the holder In Fig 3. further including a channel selector for 
the television system. 

Drawing Reference Numerals 

12 aperture formed in mating edges of parts 24 and 26 for emitter 52 
14 aperture formed in mating edges of parts 24 and 26 for receptor 54 
1$ notch in edge of part 24 for securing strain relief 28 
20 control tablet 

22 support frame Tor control tablet 20 
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6 



24 



housing top part of control tablet 20 



26 



housing, bottom part of control tablet 20 



28 



strain relief for attachment cord 32 



30 



pointing pen for indicating selections on screen 62 



32 attachment cord for pointing pen 30 ' 

34 penholder for; pointing pen 30 

36 pressure sensitive switch on tip of pointing pen 30 

38 electric contact on tip of pen 30 for position sensing on conductive screen membrane 64 

39 cursor fox displaying position of pen tip on view screen 

40 access. cover for battery compartment 48 
42 positive electrical contact 

44 negative electrical contact 

48 battery compartment * 
So batteries 
52 emitter 
54 receptor 

60 circuit board , 
62 screen for viewing selections 

64 transparent, electric conductive membrane that adheres over screen 62 
100 holder for control tablet 20 

112 aperture formed in edges of parts 124 and 126 for emitter 152 
114 aperture formed in edges of parts 124 and 126 for receptor 154 
118 notch for securing strain relief 134 
120 joystick with {pushbuttons 
122 support frame for holder 100 
124 housing top part for holder 10G 
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126 housing bottom part for holder 100 
t » access slot for inserting lasercard 172 into reader 170 
130 line power AjC adapter 
132. line power c<j>rd 
138 strain relief for cord 132 

142 positive electrical contact from power supply 148 
J44 negative electrical contact from power supply 148 
148 power supply 
152 emitter 
154 receptor 
160 circuit board 
170 lasercard reader 
— ! \ . -172 lasercard 

180 control tablet memory 
ip 182 control tablet controller circuitry 

|y 184 control tablet screen driver circuitry 

{:*:.! 186 control tablet pen position sensors circuitry 

{jSj-.j 188 control tablet receptor detection circuitry 

|p 190 control tablet emitter driver circuitry 

p<] 192 control tablet pen depressed switch detection circuitry 

200 holder controller circuitry 
4h\ 202 bolder memory 

M&v 206 holder receptor detection circuitry 

|1| 208 holder emitter driver circuitry 

p|:; * 210 video cable/satellite/antcnna channel selector 
i-ff i 212 video recorder 
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214 TV set 

216 video cable connector - input 

218 video cable cpnneetor - output 

220 selected channel indicator 

Control Tablet — Fig* 1, 2A, and 2B 

Fig 1. shows an RC device in accordance with the invention. Device 20 will hereafter be 
referred to as a control tablet because it looks like a tablet which occupies a space roughly 
equal to that of a: small open book and would normally be oriented as shown, much like a 
book laid open on a table. Tablet 20 contains a viewing screen 62 for displaying data. 
Mounted directly above and over the surface of the viewing screen is a transparent, electri- 
. caUy conductive pointing screen 64. shown in detail in Fig 4. This pointing screen is use* 
with a pointing pen 30 (Fig 1>. Both screens are rectangular in shape and of the same sire, 
approximately 21 cm x 33 cm. Both screens are surrounded by a framed area of a top part 
24 of the housing pf tablet 20. Pointing pen 30 is shown in a penholder 34. which is a clasp 
in the rear of top part 24 of the housing. The pen has also a durable and flexible attach- 
ment cord 32 containing conductors. 

As shown in Fig 2A* the underside or bottom 26 of tablet 20 ha, electrical contacts 42 and 
44. These align and mate with similar contacts 142 and J44 of a holder 100, shown in Fig 
3. An access cover 40 is also incorporated in bottom part 26. A support frame, a circuit 
board with circuits, all necessary fasteners and circuit interconnections, which, are not 
shown, but are well known to those skilled in the art, are contained within the the RC 
device. 
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Mounted iaside tablet 20 are an Infrared (IR) emitter 52 (Fig 2B) and an IR receptor 54. 
These are partly visible at the back of tablet 20 through two apertures 12 and 14, respec- 
tively, each formed of mating curved recesses in one edge of each of housing parts 24 and 
26. IR emitter 52 is used to send codes for controlling appliances such as TV set 214 or 
video recorder 212 shown in Fig 10. IR receptor 54 is used to receive program guide in- 
formation for controlling appliances and also used to receive status information from an 
appliance. 

Also included in control tablet 20 is the eireuitry to make the tablet functional. This cir- 
cuitry is represented in Fig 8. Included in this circuitry Is a memory 180 which is used for 
storing program guide information and appliance status information received from IR 
receptor 54. 

'Exploded View OS Display And Point Screens — Fig 4 

Fig 4 shows an exploded view of display screen 62 and pointing screen 64. Also shown is a 
more detailed view of pointing pen 30. Pointing screen 64 is adhered to the top surface of 
display screen 62 and is transparent and electrically conductive. When conductive tip 38 of 
pen 30 contacts screen 64, the X/Y position of pen 30 will be determined by an X/Y posi- 
tion sensor circuit 186, shown in Fig 8, If downward pressure Is then applied to pen 30, a 
switch 36 in the pen will be activated. This activation can be detected by a pen depressed 
switch detection circuit 192, shown in Fig 8. 

Holder - Fig 3 

Fig 3 shows a holder 100 for scoring, recharging and programming tablet 20. Holder 100 
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has a top or cradle part 124 and a bottom or base part 126. An IR emitter 152 and-*n IR 
receptor 154 are *hown partially visible through apertures 112 and 114 respectively, formed 
in the vertical back portion or cradle part 124. When tablet 20 is resting in holder 100. IR 
emitter 152 and IR receptor 154 mate optically with IR emitter 52 and IR receptor 54. 
respectively, for transmitting data between holder 100 and tahjet 20. So that tablet 20 may 
be recharged while resting in the holder, electrical contacts 142 and 144 are positioned in 
the bottom portion of cradle part 124 to align with contacts 42 and 44. 

To display updated, current program guide data, the RC device uses a lasercard reader 170, 
shown in Fig 9. to receive this data from lasercard 172. Lasercard 172 is preprogrammed by 
etching the data on the lasercard's surface with a laser beam. On a weekly basis, a pub- 
lisher could compile, manufacture, and distribute on a subscription basis, lasercards that 
contain this data. Alternately, new lasercards could be distributed in magazines, such as TV 
Guide. 

A lasercard reader access slot 128 (Fig 3) i, formed of two mating rectangular recesses 
along an edge on each of cradle and base parts 124 and 126, respectively. A power cord 132 
with an AC adaptor plug 130 is used to supply the power needed to operate holder 100, 
preferably ar a low DC voltage. Inside holder 100 is a circuit board (not shown) containing 
circuitry shown in Fig 9. including a memory 202 for storing program guide information 
read from Lasercard 172, discussed previously. Also included in holder 100 is a power 
supply, a lasercard reader, a support frame, and all necessary internal fasteners and circuit 
interconnections. *hieh are not shown but arc well known to those skilled in the art. 

Lasercard J72 al«* contain, command signal codes for the entire range of appliances which 
the RC device is intended to control. e.g. a plurality of makes and models of appliances. 
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such as TV and VCRs, or a plurality of different appliances, such as coffeemakefs and 
household lights. 
Operation — Fig 3 

Referring to Fig :3, as stated lasereard 172 containing current program guide information, 
is inserted through access slot 128 in holder 100 which contains a lasereard reader 170, 
shown in Fig 9. There is software present in holder 100 to control the lasereard reader. 
Program guide information is then read automatically from lasereard 172 using the laser- 
card reader, into a local memory 202, shown in Fig 9. When control tablet 20 is placed in 
holder 100, the information read from lasereard 172 will automatically be transferred, via 
IR emitter 152 and tR receptor 54 to the- memory 18Q, shown in Fig 8, of control tablet 20. 

Included in lasereard 172 is a special guide containing code information for colitrolling 
various appliances that are on the consumer market. Thic guide contains the information 
to allow a user to select, from options displayed on screen 62 shown in Fig 1, which ap- 
pliances will be employed. Using data transfer methods previously described, the ap- 
propriate codes used to control selected appliances are transferred to tablet 20 and stored 
in a non-volatile section of memory 180 shown in Fig 8. This procedure is only necessary 
the first rime the device is set up for use, or when a new appliance is added to a user's sys- 
tem. 

RC Device Display & Operation — Figs 4, 5, 6 & 7 

Referring to Fig 4, when tip 38 of pen 30 is in contact with pointing screen membrane 64 
on viewing screen 62, a group of crosshair lines 39 will appear on the screen at the point 
that the pen tip and the membrane come in contact. This is U6ed to verify to the user that 
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the pea is in contact with the screen and to indicate precisely the information on the<screen 
to which the pen; is pointing. 

To make a selection, one first touches pen tip 38 to pointing screen membrane 64. on view- 
ins screen 62. Next one activates switch 36 in pen 30 by applying downward pressure to 
pen 30. This causes the selected area or the screen to be activated and a corresponding ac- 
tion to occur. 

Available programs and control functions for a given appliance are selected from the op- 
lions displayed on screen 62. Fig 5 shows a typical spreadsheet style display showing 
program data arranged by time and channel. Screen control symbols are also displayed. 
These can be used to find a desired page of information, or section of the spreadsheet. For 
example the arrows at the bottom and right edges of Che display allow one to scroll left or 
right over the information to display program guides at different times, or up and down to* 
display further channel selections. Making a selection in the area where a particular arrow 
is displayed selects the indicated direction. A particular day or tine can also be instantly 
displayed by seleoting the appropriate box at the bottom of the screen. Finally, a particular 
mode for controlling a different appliance, or other information to explain to a user how 
to use the device, can be displayed by selecting the indicated boxes. 

For example selecting the section of the screen labeled -TURN DESCRPTN ON", one can 
cause the display to show movie reviews, episode blurbs, advertisements, and the like. By 
making a selection in the area where a particular show's title is displayed on the tablet 
screen, that show Will be viewed at the time the show is broadcast. If the show selected is 
set for a future broadcast, the device would also turn on the appliance at the selected time 
to remind the user ithat the selected show is currently being broadcast. If immediately after 
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making a show selection the user selects the "TURN RECORD ON" area on the display, the 
recording appliance will be activated to record selected show at selected time, if the user's 
system has rccordjing capabilities. 

When the device is in the "TV SHOW SELECTION MODE", as indicated at the bottom of 
Fig 5, the making of a show selection will activate the appliance to display the selccrod 
show at the selected time. For example, suppose the current time is 9:00 PM on Friday, Oct. 
26th 198$. Selecting the Miami Vice box will cause TV set 214, shown in Fig 10, to change 
to Channel 4. If however, one selects Srarman. TV set 214 will automatically be changed to 
Channel 6 by the control tablet at 10:00 PM. Similarly, one could select many advance 
programs, even days ahead, up to the programmed limit of lasercard 172, previewing 
descriptions when desired. The control tablet will also remember selections watched on a 
weekly basis and will preprogram itself to correspond to the viewing habits of the user. 
For example, if regularly at 9:00 on Friday, the user watches Miami Vice, the control' tablet 
will notice this viewing habit and automatically change the channet to Miami Vice if the 
TV is on Friday at 9:00 PM. Of course a user could bypass this feature by merely selecting 
another program to watch. 

While actually viewing and/or listening to a particular program, screen 62 will display 
more conventional controls for functions such as VOLUME UP, VOLUME DOWN, PREV 
SONG, NEXT SONG and STOP PLAYER as shown in Fig 7. ir transmitting appliances are 
available, control tablet 20 can receive information from certain of these appliances and 
display it on screen 62. Referring to Fig 7 for an exemplary screen display, a compact disc 
player could transmit content and selection descriptions of songs available for display on 
the tablet. . 
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To change models, one would select the "CHANGE MODE" area on screen 62. This -would 
cause the display to show a "SELECT APPLIANCE MODE" menu. A exemplary repre- 
sentation of this; menu is shown in Fig 6. This display can have different information then 
that shown, depending on the configuration of the system. To change the mode to a dif- 
ferent appliance, one wouJ4 select the area on the screen that corresponds to the appliance 
: the user wishes to use. 

-Since only the available control selections for an appliance will be displayed at any given 
'time, available selections will be simplified and become more obvious. Unused functions 
that can cause cbnfusion to the user, will not be displayed. Program guide choices and 
description* for an appliance are readily available for display. A user can easily make 
program guide choices from the selections shown on the display. 

The RC device makes controlling an appliance fun and easy. There are no buttons ^'push 
or codes to memorize. Vast amounts of information can be instantly displayed and com- 
mand choices are obvious. Similar appliances are controlled in the same manner. If a user 
employs a system different then the one they have, the new system would be controlled in 
the same manner that they would control their system. There is no need to learn how to 
operate a new remote control. Since program guide information is stored in the RC device, 
there is no need for the typical printed guide, which can easily be misplaced. 

Control Tablet Circuitry — Fig 8 

The internal construction or the control tablet and charger/cardreader will now be 
described in detail. 
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Referring to Fig 8, control tablet 20 consists or eight circuit blocks whose functions-arc as 
follows: 

1. A controller 182 to process the data needed to make the control tablet functional. This 
circuit would typically be a single chip microcomputer. 

2. A memory ISO to store the data to make the control tablet functional. This memory is 
connected to controller 182 and is divided into three groups as follows: 

A. An Electrically Erasable Programable Read Only Memory (EEPROM) is a per- 
r . manent, but alterable memory for storing configuration information. Alternatively, 

one could use a battery back up Read Ana^write Memory (RAM), often imprecisely 
called a Random Access Memory. ~ 

B. A Programmed' Read Only Memory (PROM) is used to store the microcode in- 
structions that controller 182 uses to process the data. 

C. A data RAM is used for storing program guide data and as a scratchpad memory 
for controller 1S2. 

3. A screen driver 184 is connected to controller 182 and consists, of circuitry needed to 
activate viewing screen 62 so that program guide information and appliance control selec- 
tions can be viewed. 

4- A pointer position sensor circuit 136 is connected to controller 182 and is used to trans- 
late the X/Y position of pen 30 into a form that the controller 182 can process. This cir- 
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cult will apply alvoltage across position screen membrane 64 alternating across the horizon- 
tal plane, then vertical plane. Pen tip 38. when in contact with membrane 64. will detect a 
voltage drop that corresponds to the pen position on the membrane. Circuit 186 will then 
translate the detected voltage into an actual position that the controller 182 can under- 



5.5. Ancircuit 18* detect, data at IR receptor 54 so that controller 182 can process the 
received information from external devices. This circuit consists of a voltage comparator 
that detects a voltage from the IR receptor when it is activated. 

6. A circuit 190 enables controller 182 to drive IR emitter 52 to transmit information to 
external devices. This circuit consists of a transistor that drives IR emitter when activated. 



7. A circuit 192 enables controller 182 to detect activation of 



position pen switch 192. 



8. Hardware to supply power to control tablet 20. This consists of a rechargable battery, 
a battery compartment 40. and a pair of battery reeharger pads, 42 and 44. 

Circuitry also includes all of the interconnection, between above mentioned circuits to 
make- the tablet functional. 

Holder Circuit — Fig 9 



Fig 9 Shows circuity for holder 100. It consists of five circuit blocks whose functions are 
as follows: 
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1. A controller: 200 to process the data needed to make the holder functional. Thh con- 
troller would typically be a single chip microcomputer. 

2. A memory 202 to store the data to make the holder functional. This memory is divided 
into two groups ais. follows: 

A. A PROM is used to store the microcode instructions that controller 200 uses to 
process the data. 

B. A data: RAM is used for storing program guide data and scratchpad memory for 
controller 200. 

3. A circuit 206 detects' data present at IR receptor 154 so that controller 200 can process ■ 
information received from external devices. Thil circuit consists of a voltage comparator 
that detects a voltage from the IR receptor when it is activated. 

4. A circuit 208: used so that controller 200 can drive IR emitter 152 to transmit informa- 
tion to external devices. This circuit consists of a transistor that drives IR emitter when 
activated. 

5. A circuit 204 that enables controller 200 to access the .program guide information stored 
on lasercard 172. This circuit consists of an integrated circuit the manufacturer of the 
lasercard reader supplies for interfacing lasercard readers to controllers. 

6. A power supply 146 to supply power to holder 100. This includes power cord 132 and 
plug 130 for connection to external power source. Also included are a pair of recharger 
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pads 142 and 144; to recharge control tablet 20, 
Configuration Of; The System — Fig 10 



The configuration or layout for a typical complete video system consisting of a TV, VCR, 
etc. is shown in Fig 10. Control tablet 20 and holder 100 can be mated and separated. As 
stated, the program guide information is read by the holder by the lasercard reader. In 
this configuration holder 100 is a stand alone unit which is not directly connected to the 
system. In this configuration decoded video signal output from a video 
cable/satcllite/antenna channel # selector is input into video recorder 212. The video sig- 
nal from video recorder 212 » supplied to TV set 214. Control tablet 20 sends codes that 
control the channel selector, video recorder, and TV set, and receives program guide infor- 
mation from holder 100. - 

Alternative Configuration Of The System Fig 11 

Fig il illustrates a typical video equipment cable interconnection with control tablet 20 
and holder 100 where the pragram guide information is downloaded from video 
cable/satellite/antenna channel * selector system 210. Program guide information is en- 
coded and decoded on a selected channel by methods currently used to display text during 
•Closed Caption" broadcasts for the hearing impaired. Since program guide data is 
downloaded through a video connection, there is no need for a lasercard or lasercard 
reader. This configuration has the advantage that if the program guide is changed at the 
last minute, eg., for an emergency news flash, the information can be instantly downloaded 
and updated in the control tablet. Appliance interconnections would be identical to those 
described in Fig 10, except that holder 100 would be connected so that it would input the 
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video signal output from channel decoder 210, and the video signal output from the bolder 
would be che input into video recorder 212, 

Alternative Pointing Method* — Fig 12 

The preferred embodiment described above has a screen incorporated in the control tablet. 
Other variations iare possible. For example as shown in Fig 12, a joystick type control 120 
could be employed to move a cursor on a display shown on the viewing appliance. Opera' 
tipn would proceed as above, except that the user would have to use the joystick and a 
pushbutton to move the cursor and make selections rather then the pen method previously 
discussed. Selection information would be displayed on the TV set, rather than the display 
h» the RC device. With this configuration holder 100 hns charactor generation circuitry 
used to build the screens on the TV set that are normally- displayed on tablet 20. 

Optional Embodiment Combining Holder & Channel Decoder — Fig 16 

An optional embodiment of the holder of Fig 3 is shown in Fig 16. In this configuration 
holder 100 also incorporates channel decoder 210 in its housing. Mounted on the surface of 
this holder is a video connector 216, for receiving the undecoded signal and a video con- 
nector 218, for supplying the decoded signal to TV set 214. Also incorporated is a channel 
indicator 220, this to displays the current channel being decoded. 

Control Tablet Flowchart'-- Fig 13 

A flowchart in Hlg 13 represents the main loop of the control tablet program which is 
stored in PROM li80. Basically the program loops through the following steps: 
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1. Update display to show possible selections. 



2. Determine If the pointing device is being used. If the pointing device is not being used, 
then Hag that it is, not being used by a return to Step 1. 

3. Flag that the pointing device Is being used. Determine if a selection is being made. If a 
selection is not being made then return to Step 1. 

4. A selection has: been made so execute the action that corresponds to the position of the 
pointing device, then return to Step 1. 

The following is a detailed explanation of the blocks, in the flowchart. The remaining 
operations are selfUexpJanatory and will be easily understood by one skilled in the art. 

Block 50 (Init) represents a one time initialization step that starts off the flow chart. Here 
variables are initialized and configuration information is selected. 

Block 52 (Display Screen) represents a step, in which the display is updated with informa- 
tion pertinent to the current mode and selection information. It displays the cursor if the 
pointing device is being used. 

Block 54 (In Holder?) represents a decision which the system determines whether the con- 
trol tablet is in th* holder, ir it is not in the holder then the system will continue opera- 
tion at block 58. 
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Block 56 (Download Data) represents a step In which program guide information is 
received by the tablet from the holder. The system then continues operation at block 52. 

Block 58 (Pointer Used) represents a decision which the system determines if the pointing 
device is being used. If the pointing device is being used then the system will continue 
operation at block 62. 

Block 60 (Cursor lOff) represents a step that flags the pointing device is not being used so 
that the cursor will not be shown on the display. The system then continues operation at 
block 52. 

Block 62 (Cursor On) represents a step that flags that the pointing device is being used so 
that the cursor will be shown on the display. , „' 

Block 64 (Is Selection?) represents a decision which the system determines if a selection is 
being made. If no; selection is being made then the system continues at block 52. 

Block 66 (Find Position) represents a step that determines the position of the pointing 
device. 

Block 68 (Do Selection) represents a block determines which appropiate action block 70 
through 92 will be executed by the position determined in block 68. The system then con- 
tinues at block 52. 

The following blocks, 70 through 92, detail the routines that can be executed from block 
68. 
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Block 70 (Program Selection) represent* a make program selection routine. This routine is 
called if a selection is made in the spread sheet program guide area of the display. This 
routine determines on what show the cursor is located and flags that program guide selec- 
tion to be displayed at the appropiate time. The actual changing of the channel is done in 
Fig; 14 during a timer interrupt routine. 

Block 74 (Change! Date) represents a change date to display routine. This routine is called 
if the pen tip is depressed on the screen above the date bar. The program determine, what 
date that they want to display the guide for and saves it i„ memory so the next time the 
screen is displayed the program guide for the selected date is displayed. 

Block 76 (Change |rime) represents a change time to display routine. This routine is called 
if the pen tip»f depressed on the .screen abov* the change time bar. The program deter- 
mines what time is selected and saves it- in memory so that when the next time the screen is 
displayed the program guide for the selected time is displayed. 

Block 78 (New Window) represents a change the vertical selection window routine. This 
routine is called ir the pen tip is depressed on the screen abovp the vertical scroll bar 
which is located directly to the right of the guide display. If there are more channel selec- 
tions then can be displayed on the screen at one time, the program determines where to 
center the window; by the position of the pen in the bar and saves it in memory so that the 
next time the screen is displayed it displays the selected channels in the program guide 
selection area. 

Block 80 (Volume Up) represents a send volume up routine. If the pen tip is depressed on 
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the screen above the volume up arrow then the control tablet will start sending volirme up 
commands to the TV until the pen tip is let up. 

Block 82 (Volume Down) represents a send volume down routine. If the pen tip is 
depressed on the screen above the volume down arrow then the control tablet will start 
sending volume down commands to the TV until the pen tip is let up. 

Block 84 (Mute Toggle) represents a send mute command routine. If the pen tip is 
depressed on the .screen over the mute icon then the control tablet will send the mute com- 
mand to the TV. If the TV is already muted the program will send the mute oTf command. 

Block 86 (Help Toggle) represents a toggle help mode routine. If the pen is depressed on 
x the soreen above the Help icon then the control tablet toggle will turn on the help feature if 

/ the help feature Is off and turn it of f , if on. 

Block. 88 (Record On) represents a record mode routine. If the pen is depressed on the 
screen above the record icon then the video recorder will be flagged to record the program 
selection. 

Block 90 (Description Toggle) represents a toggle program description mode routine. If the 
pen is depressed on the screen above the description icon. then the control tablet will toggle 
the description mode flag. If the flag is on when a guide selection is selected then a 
detailed description of the selected program will be displayed on the screen. If the flag is 
off then the tablet would not display that information. 

Block 92 (Appliance Selection) represents a go <o appliance selection menu routine. If the 

) ■ • 
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pen tip is depressed on the screen above the go to appliance menu icon, then this causes the 
mode of the tablet to be changed so that a menu will be displayed. You could then choose 
another appliance, i.e. compact disk player, etc... 

Background Program Task Flowchart — Fig 14 

A flowchart in Fig U represents the background program task, stored in PROM 180, that is 
executed during: a timer interrupt This routine is run on a regular basis and does all the 
switching of the-TV, VCR. etc. The steps that happen during that interrupt are described 
as follows: 

Block 100 (Adjust Time) represents a routine that adjusts for the time of day by increment- 
' Ing tho time variables. 

Block IX)2 (Is Channel Set) represents a decision that determines if the channel being 
watched for the current time is the channel dcrired. If so then the program continues at 
bloek 106. 

Block 104 (Change Channel) represents a routine that actually changes the channel 

Block 106 (Should VCR Be Recording) represents a decision that , determines if the VCR 
should be recording and is not. If the VCR is recording then the program continues at 
block 110. 

Block 10* (Turn VCR On) represents a routine that turns on the VCR and starts it record- 
ing. 
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Block 110 (Data At Receptor) represents a decision that determines if data is present at the 
IK, receptor. If no data is present then the program continues at block 1 14. 

Block 112 (Store Data and Take Any Necessary Action) represents a routine that stores the 
data received at the IR receptor. The program will then take an appropiate action to flag 
the main program that data was received, 

Block 114 (Return From Interupt) represents a routine that restores the program environ- 
ment, then returns control back to the main loop program. 

Holder Flowchart - Fig 15 

The flowchart in Fig 15 represents the program loop, stored in PROM 202, running in 
holder 100. It is a simple program whose description is as follows. 

Block 150 (Init) represents a one time initialization routine. Here variables are initialized 
and the program environment created. 

Block 152 (Lasercard Present) represents a decision that determines if a lasereard has just 
been inserted into the lasercard reader. If no lasercard is present then the program con- 
tinues at block 156. 

Block 154 (Read Lasercard) represents a routine that reads in the necessary information off 
the card and stores it in the holder's internal memory. 
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Block 156 (Tablet In Holder) represents . decision that determines if the control tablet is 
positioned in the holder. If the tablet is not in the holder the program return, to block 152. 

Block 158 CDownioad Data) represents a routine that download, program data stored in the 
holders memory to the tablet. The program then returns to block 152. 

Summary, Ramifications, & Scope - Control Tablet 

As previously described, the RC device basically incorporates a TV guide, a screen for dis- 
playing the TV guide, and a pointing deviee for making selections from such guide. Images 
composed of word, for descriptions and symbols for representing command, can be dis- 
Played on the screen. Commands are grouped in sets which are not all shown at once. Each 
set, or menu, contains a group of commands appropriate for a relectcd a PP Hance. Also in- 
eluded in each gr*up are commands for changing from menu to menu. Symbols a. well as 
command descriptions can be used to represent commands, and can be tailored to suit the 
individual user. For example if the device were to be in the command mode for adjusting 
a graphic equalizer for an audio system, the screen may display the current setting. i„ the 
familiar barsraph form tnat thc us „ „ accustomcd ^ Tq change & ^ ^ ^ 
simply .elect the bar one desires and slide it up or down to the desired position. Only the 
commands pertinent to a particular mode are displayed at one time, reducing confusion. 
Detailed descriptions can be displayed to inform thc user of the command function. By 
«i«g the screen in the above described fashion, command, to control similar appliances 
from different manufacturers are displayed in the same manner. This allows for uniform 
control of appliances from system to system. 

Another feature of the RC device « automatic program selection and recording. Enter. 
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tainment programs in a guide are displayed, typically in a spread sheet fashion, as well as 
with full prograin content descriptions. To view a show the user need merely select an area 
on the screen displaying that show's titlo. Automatically, the necessary commands will be 
generated and transmitted from the control tablet to the appropriate receiving appliances. 
The appliances respond in the ordinary manner as when directed by the original pushbut- 
ton control. 

The RC device is especially useful with cable television selectors. Quite often the channel 
selected on the cable box is not the actual broadcast channel that you may wish to watch. 
Often one must use a separate table of broadcast channel numbers to convert to the actual 
cable channel numbers you wish to select. Since many cable channels, e.g. Shflyctinifi. don't 
have broadcast channel numbers so the cable channel numbers have to be memorized. 
Using the RC device of the present invention eliminates these problems. When a selection 
is made for a, desired program, the control tablet makes the conversion or selection 
automatically and issues the correct command. 

Since program selections are displayed on the screen of the RC device, a user does not have 
to have the typical printed version of the printed program guide, which is easily misplaced. 
A user may need to have this printed version of the program guide in order to operate some 
RC devices properly. These RC devices do not provide for channel conversions or display 
of program selections. They also work with VCR's only and are still complicated to use. 

Summary, Ramifications, & Scope - Uses With Recording Appliances 

When an appliance has the ability to record video or audio medium, it can be confusing to 
a user to select a channel, start record time, and stop record time for the recording ap- 
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pliance. The present RC device has a simple solution to this problem. One need merely ac- 
tivate the desired selection from the program guide displayed on the viewscreen for a 
selected appliance. Then the user informs the RC that the user wishes to record that 
program selection. This is done by activating the "TURN "RECORD ON" function selection 
on the viewscreen. The RC device would then send the appropriate signals to the recording 
appliance at the appropiate time so that the program selected would be recorded. This 
would also allow recording of future selections even if the recording appliance does not 
have the ability to be programmed to record at a future rime. In such a case, the RC 
device would wait until the time selected for the desired program. Then start the recording 
appliance to record from the desired channel. The RC device would then turn off the 
recording appliance when the program selected is done. 

The previously mentioned feature can also be used fix another problem that exists with 
most programmable recording appliances. That is the ability to recerd multiple selections 
at different times. The RC could solve the problem of having to decide which soap" opera 
the user wants to record while at work. The RC would control the recorder so that both 
shows were recorded properly. 

Summary, Ramifications, & Scope - Holder and Transmitting Appliances 

Additionally, appliances with transmitting capabilities can send information to the control 
tablet. One such! appliance is a holder for the control tablet the combines a battery charger 
and a Iasercard reader. Current program information stored on a lascrcard and read by the 
reader when the, card is inserted in the reader. This information is transrered by IR 
transmission to the control tablet. 
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A special guide included with the program guide information on the lasercard contains in- 
formation for possible different configurations of appliances. The control tablet is initial- 
ized for the user's particular models of appliances, when the user completes the selections 
directed by the special guide. This procedure would only be required before the first use 
of the appliances or control tablet, or when an appliance is changed or added. The special 
guide: information would also be updated, in successive lasercard issues, when necessary for 
initializing any new appliances which comes to the market. 

Other transmitting appliances could send various status information to the tablet such as 
current channel, elapsed time. etc. Recorded formats, loaded into transmitting appliances 
could send their program content to the tablet for automatic selection in a similar manner 
as described above. For example, upon insertion of a compact disk into a compact disk 
player, the song ; titles and order may bo transmitted to the control tablet. The control 
tablet will memorize this data and display 'it on the screen when the compact disk mode is 
selected. One would select the songs titles in the order desired to be listened to and the 
tablet would then program the compact disk player to play the songs in the order selected. 

Summary, Ramifications, & Scope « Optional Embodiments 

While the preferred embodiment employs a lasercard reader in the holder for acquiring 
guide updates, other methods may be used for receiving program information. For ex- 
ample, one could! use a floppy disk reader or download such information over telephone 
lines or use a transmission channel by either cable or wireless means, including by satellite. 
Also, numerous means could be used in place of, or in addition to, the infrared laser emit- 
ter and receptors shown in the preferred embodiment. These means could be microwave, 
radio, carrier current or direct wirclink. 
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It should be noted that the screen does not need be built into the control tablet. It is pos- 
sible to use the screen on the television to display the guide and selection information. 
This has disadvantages due to the fact that in order to control an appliance, the user must 
be in viewing range of a television. The user also must have a television in the first place. 
Also, if the user is using the television display to show television selection decisions, the 
displayed information may impede with the television selection currently being viewed. 

It may be noted that many different pointing devices could be used instead of a pen. 
These may include joysticks, lightpens, optical and mechanical mice, and possibly eye posi- 
tion sensors, that register what the eye is looking at. 

Finally, other equipment, including telephone accessories, heating and ventilating controls, 
kitchen appliances and the like, can be controlled by the tablet described above, so long as 
the equipment has the appropriate receiving apparatus. Having on the tablet screen a plan 
view of a room, for example, one could represent symbolically each light, appliance, or 
piece of equipment in that room. Using the pointing pen one could point to a desired tem- 
perature on a symbolic thermometer to control heating, turn a light symbol on or off to 
control a fixture, move the hands of a clock on a coffee pot picture to set the start brewing 
time, and so on. 

The automatic program selector is easy to use and versatile. It vastly reduces confusion, 
and provides helpful information on demand. Large amounts of information are acces- 
sable, numerous- control options for a plurality of appliances are available, and the display 
is in smaller amounts that are more clear and understandable. Selection by the guido in the 
control tablet eliminates many intervening and frustrating steps, otherwise necessary with 
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ordinary hand-hold remote controls. 

While the above description contains many specifitles, the reader should not construe these 
as limitations on: the scope of the invention, but merely as exemplifications of preferred 
embodiments thereof. For example skilled artisans will readily be able to change the 
dimensions and shapes of the various embodiments. They can use many other display 
devices other then those discussed. They can use many other pointing mothods then those 
discussed. They Can use many other methods to receive program guide and appliance status 
information then those discussed, and they can use many other methods for controlling an 
appliance then those discussed. Accordingly the reader is requested to determine the scope 
of the invention by the appended claims and their legal equivalents, and not by the ex- 
amples given. 
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Claims 

1. A remote: control for enabling a user to control at least one electronic device, 
comprising: 

a first housing, 

a viewing screen in said first housing for symbolically displaying a variety of available 
choices for a controllable electronic device, 

pointing means in said first housing for selecting one of said choices on said viewing 
screen, 

means in said first housing for interpreting the selections made and for generating cor- 
responding display information and corresponding transmission information for said con- 
trollable electronic device, and 

• transmitting means in said first housing,, for sending an appropriate command, repre- 
senting the selection made, to said controllable electronic device. 

receiving means in said first housing for receiving, from an external source, program 
guide information for use with said controllable electronic device, 

means f or storing and retrieving program guide Information, and 

means for displaying and selecting said stored and retrieved program guide information. 

2. The remote Control device of claim I, further including energy storage means in said 
first housing for supplying operation power to subsequent elements in said first housing. 

3. The remote control device of claim 1, further including means for charging said energy 
storage means. 

4. The remote control device of claim 1, further including: 
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a second housing, 

receiving mcains In said second housing for receiving, from an external source, program 
guide information for use with said controllable electronic device, 

transmission means in said second housing for transmitting said program guide informa- 
tion to said remote control device, and 

means for enabling said remote control device to receive and transmit program guide in- 
formation. 



PCT/US88/03344 



5. The remote control device of claim 4. further including channel selection means in said 
second housing for use with said controllable electronic device. 

6. The remote control device of claim 1, further including: 

receiving means in said housing for monitoring changeable conditions transmitted by 
said controllable electronic device, and . 
means for displaying the resultant monitored conditions. 

7. The remote control device of claim 1 wherein said device contains means for controlling 
a plurality of said controllable devices by sending the appropriate commands to the desired 
said controllable device. 



Copied from 10354344 on 08/25/2005 




Copied from 10354344 on 08/25/2005 



08/07/97 16:41 



REEDFRX 



NO. 845 038 



W089 /° 3085 PCT/US88/03344 



3*? 



0 



□ 



-0 



BOTTOM 



BOTTOM VILW 
OF T^LLT 



Copied from 10354344 on 08/25/2005 




Copied from 10354344 on 08/25/2005 




Copied from 103.54344 on 08/25/2005 



08/07/97 16:43 REEDFRX -» 912125969090 



NO. 845 042 



WO 89/03085 PCT/US88/03344 



oaf 





it : Frido/, Oct. M, 1966 W.OO 
Hlotrf Vlea 


m Chanrfcl 4 BOI 6a 
10: 00 . j 10 JO 




IS 
50 A 

RR ^ 


z 
s 




eeu, Paul lata 


TSS L 


Lata Bbm , 


A-Tara 


Manri V»ob 


U Uw 


teifi - 


4 


A'Tam 


Mint Vice 


U Law 




5 


Oreac 
Puipkin 


Dallas 


Falcon Crast 


•Bfi 


t, 


uall 
screat 


Crane parfornancaB 




KM 


7 


BsWacWe 
W 


Hawli | Sidekick* 


Stormn 


NEU5 
//A 


1 KJIH 1 VCOIC 


UU i «1 *i «l s * 7| »l * 

| SlA | Mm | 7UK | Uxto | Thjr 1 Fr< [ «| 

i ounce 1 ; 

1 HUE I j Curent tefe : TV Show Salactlcn 


1 1 « 1 



Copied from 10354344 on 08/25/2005 



FIC,-5 

T.V. APPU'A" -'- 



08/07/97 16:44 REEBFRX -» 912125969090 



NO. 845 D43 



WO 89/03085 



PCT/US88/03344 



Coipact Disk Ploxr 



- Orrent Hoefc i AppUax* Salaccten 



Copied from 10354344 on 08/25/2005 



08/07^97 16:44 REEDFfiX -> 912125969090 NO. B45 044 



WO 89/03085 O /-f J PCT/US88/03344 



B//7 



'l. IhtBay inlheaubbtv; 3:39 


7. tttfer African Sk\t* 3;3* 


2. CrmUrd : 


B. Hoelesa 3:*S 


3. I ttcM Vhac 1 Hrcu ■ 3:13 


9. Craxy u»c Vol 11 4:17 


4, Ourfcoote : 2:« 


10. Uat Un far Mather ZA\ 


S- Dhmrrfc CM Tho Solas; SsS* 


11. All Aran* T»w Vbrld 3:15 


6. Tea Can Call Ha Al ««» 





Orrent Seng : |Th« 9Qf Jn 1h» BLfcble 



A 
V 



H0D8 I Orrent Mo* : Caipnct 



D!sk selection 



Copied from 10354344 on 08/25/2005 



e>U/tfW3? lb: 44 KiEEUFflX - 912125369090 



NO. 845 D45 



WO 89/03085 



PCT/US88/03344 



sr- 



I 



POINTIWO PEM SWlTOt 



<= 



posrrinu 



7^ 



.Z.VtL.'TKJU.A.y 



FIU.-B 



Copied from 10354344 on 08/25/2005 



08/07/97 16:45 RBEDFRX 912125SS9090 



NO. 845 OAS 



WO 89/03085 



PCT/US88/03344 



*/9 



i 



<3=" 



Fit. °> 

BLOCK. blALR^M OF 



Copied from 10354344 on 08/25/2005 




TYPICAL 

CDKI Fl Co L) RRTTQ NJ 



Copied from 10354344 on 08/25/2005 




Copied from 10354344 on 08/25/2005 




1^ 

ii fa 



ric. 12. 

ALTtRWATLVC 
fir fsYr.TLM 



Copied from 10354344 on 08/25/2005 



WO 89/03085 



PCT/US88/03344 














* QfcTL. 








TIMt 




- ■ Vfr 












VOLUMt 
UP 

Bj/ 






-» 


VOLUMt 




8* 




MUTS^ 








HU.P 






-» 










DESCRX.PT1DH 
T&LUUL 




-* 


APPL1AVU.E. 





FLOW CHART TO CONTROL TAEA.iT 



Copied from 10354344 on 08/25/2005 



BS/BV/^V 16: .1= REEDFHX -♦ 212596935)2 



MO. e46 003 



WO 89/03085 



PCT/US88/0S344 



ACJObT 
TIME 



CUKUKU- 





















fterufki 
uitwupt 


" 


TAtt AMY NUtib- 
ACTtOU 





FIL». iA StAlTlMt XUTlfcUPT PSOt*«*Y 



Copied from 10354344 on 08/25/2005 



08/07/-3Y 16:5kJ REEDFHX 2125969092 



NO. 846 Q0fi 



» 89/03085 PCT/US88/03344 




Copied from 10354344 on 08/25/2005 



